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Orientation selectivity is a remarkable feature of the neurons located in the primary visual cortex. 
Provided that the visual neurons acquire orientation selectivity through activity-dependent Hebbian 
learning, the development process could be understood as a kind of symmetry breaking phenomenon 
in the view of physics. The key mechanisms of the development process are examined here in 
a neural system. Found is that there are at least two different mechanisms which lead to the 
development of orientation selectivity through breaking the radial symmetry in receptive fields. The 
hrst, a simultaneous symmetry breaking mechanism, bases on the competition between neighboring 
neurons, and the second, a spontaneous one, bases on the nonlinearity in interactions. It turns out 
that only the second mechanism leads to the formation of a columnar pattern which characteristics 
accord with those observed in an animal experiment. 
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I. INTRODUCTION 

The primary visual cortex (VI) is the first cortex area 
which receives visual signals from the retina via the lat¬ 
eral geniculate nucleus (LGN). The VI neurons have the 
typical property to make distinct responses to a small set 
of visual stimuli[l|. They have individual receptive fields 
on the retina, where the center of the receptive fields be¬ 
comes the primary feature of the VI neurons. The next 
important feature is the orientation selectivity, through 
which the VI neurons detect local bars or edges at the 
early stage of visual processing. The neuronal responses 
also discriminate small changes in spatial frequencies and 
colors. Furthermore, the VI neurons have ocular domi¬ 
nance (OD), namely turning to one of the two eyes. It 
is not that the VI neurons have individual features ran¬ 
domly. They cluster together with others exhibiting sim¬ 
ilar features and form a columnar pattern structure, or 
the called self-organizing feature mapQ. The distribu¬ 
tion of receptive field centers forms the retinotopic map. 
And, a columnar pattern of orientation selectivity (or 
OD) becomes the orientation preference (OP) (or OD) 
map. 

A number of models have been suggested to unravel 
the mechanism of visual map formation!^ Q. Some of 
them adopt low-dimensional vectors to represent the fea¬ 
tures of the VI neurons (sl-flTjl. For example, the features 
of VI neuron i can be expressed by the vector with five 
components (x* ,yi,Pi cos 24 >i,pi sin2(^i, Zj), where (xi, yi ) 
and {piCOs2(j)i,piSui2(pi) represent the center of recep¬ 
tive field (or retinotopy) and the orientation preference, 
respectively. And, Zi represents the ocular dominance. 
The abstract models provide with the advantageousness 
in simulation and analysis of visual map formation. They 
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help to reproduce or explain the typical characteristics of 
columnar patterns observed in VI easily. Interestingly, 
ignoring retinotopy, the low-dimensional vector corre¬ 
sponds with a spin model vector [l^ [l^ . Moreover, the 
many characteristics of an OP or OD map have anal¬ 
ogy with those of a magnetic system Q. For exam¬ 
ple, an OP map embraces singular points, dubbed pin- 
wheels, around which preferred angles change by multi¬ 
ples of 180° along a closed loop. Pinwheels corresponds 
to (in-plane) vortices in magnetism, and are used to be 
annihilated during the visual map formation as vortices 

do[Il[i3. 

Meanwhile, some other models adopt high-dimensional 
feature vectors, which components represent the affer¬ 
ent connectivity from the retina ganglion cells (RGCs) 
(or the LGN cells) to the VI neurons in usual. A 
high-dimensional feature representation model, reflect¬ 
ing more biological factors, is essential for inquiring how 
the VI neurons acquire their typical features through 
a learning process. A correlation-based learning model, 
adopting high-dimensional feature vectors, was suggested 
to explain the formation of the OP or the OD map[l^ 
m. And, it was introduced a simplified version of the 
correlation-based learning model, which adopts only lin¬ 
ear interaction terms (l9l|. It was also demonstrated that 
such a linear learning model can lead to the formation of 
a retinotopic (or topographic) map [2^. 

Analytically, the development of a typical feature in 
a neural system relates to the existence of a symmetric 
property in external inputs. It is the symmetry in left 
and right RGC activities which becomes the origin of the 
OD development [l^ . And, the translational symmetry in 
RGG activities becomes the cause of the retinotopic map 
regulation!!^. Note that the organization of a columnar 
pattern relates to the translational symmetry in lateral 
interactions. 

Analogically, the rotational symmetry in visual inputs 
may relate to the development of orientation selectiv- 
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ity; however, there are different opinions about the de¬ 
tail mechanism. The discharges of RGCs are determined 
by the convolution visual inputs with center-surround 
receptive fields, where the center is either ON or OFF 
while the surround is the opposite. A major suggestion 
is that the two different types of receptive field is the 
essence of the orientation selectivity development: There 
are the models which explain the feature development by 
the competition or the Moiree interference between ON- 
and OFF-center type RGCs[l3, [H, [HI- On the other 
hands, there ia the suggestion that the development of 
orientation selectivity is possible independently of OFF- 
center RGGsjl^. It is known that the receptive field of 
neurons have a near Gaussian distribution shape when 
a topographic map develops in a neural network with 
homogeneous input neurons [l^. The neurons would ac¬ 
quire the feature of orientation selectivity additionally if 
they lost the radial symmetry in the receptive fields. 

Based on the view, the development of orientation se¬ 
lectivity is investigated here in a learning model. The 
model, derived from biological neural dynamics and 
synaptic plasticity, has an extended form of the linear 
learning model which was studied for the topographic 
map formation. Observed is that there are at least two 
different mechanisms which lead to the symmetry break¬ 
ing in receptive fields for the development of orienta¬ 
tion selectivity. The first is a simultaneous symmetry 
breaking mechanism, bases on competitive interactions 
between neurons: Under a large degree of competition, 
receptive fields should be squeezed in order to reduce the 
overlap with neighbors. While the first mechanism is re¬ 
gardless of nonlinear interactions, the second requires a 
high order interaction term for the development of orien¬ 
tation selectivity. The second is a spontaneous symmetry 
breaking mechanism, through which the radial symme¬ 
try of receptive fields are broken independently of inter¬ 
actions with neighbors. Both the mechanisms lead to 
the development of an OP columnar pattern with singu¬ 
lar points; however, the emergent columnar pattern has 
the characteristics being somewhat different (or coincide) 
with those in experimentally observed ones when the first 
(or the second) mechanism leads the symmetry breaking 
phenomenon. 

II. THE MODEL 

Suppose a neural network composed of input-output 
two layers, where output neurons have flexible feedfor¬ 
ward (unidirectional) connections from input neurons 
and static lateral (bidirectional) connections with other 
output neurons. Suppose the continuous function (j)(,(t) 
(G [0,1]) stands for the firing probability of neuron £ at 
position ri = (xi, ye) and time t averaged over trials. La¬ 
beling input and output neurons with indices (a, b) and 
(j,j), respectively, suppose the firing probability of neu¬ 
rons are expressed by the equation 

Mt) = Vait) + ha{t) ( 1 ) 


and 

= Viit) + X! [^ia4>a] {t) + ^ [DijOjaffia] (t) (2) 

a j,a 

+ Z1 (t). 

a,b 

Here r]e(t), assumed to be generated by Poisson process, 
represent endogenous neural firings due to noisy currents 
and ha{t) neural firings due to external visual inputs. 
With the brief notation [Die(l)e]{t) = f dsDie{s)(j)e{t—s) 

and = J dsds's')4>a(t-s)4>bit-s'), 

the interaction strengths are expressed in the form 


Du{s) = X{s)Wu 

(3) 

and 


D^Mis,s') = X^^\s,s')WMb. 

(4) 


Here A(s) and A(^)(s, s') relate to the time delay in firing 
propagation, and Wu are the scaled coupling strengths. 
Experimentally, A(s) and A^^^ (s, s') could be measured by 
the derivative of the firing propagation probability with 
the respect to the scaled coupling strengths!^. 

Meanwhile, a biological synapse changes its efficacy 
depending on the precise difference between post- and 
presynaptic firing times [l^, According to the 

mechanism, the called spike-timing-dependent plasticity 
(STDP) rule, the rate of change in feedforward connec¬ 
tion strength can be expressed in the from 

AVUq = j dt j dt' F{t-t')(l)i{t)4>a{t'). (5) 

Here F{t) describes the dependence of the synaptic mod¬ 
ification on the difference between the post- and the 
presynaptic spike times. Usually F{t) produces long¬ 
term potentiation (LTP) or positive change in a synapse 
when f > 0, and long-term depression (LTD) or negative 
change otherwise. 

Substitution of Eq. ([2]) into Eq. ([S]) leads to the learning 
model for the visual map formation expressed as 

AW,a = E Jij,a^^ja H” E W^bCba + Y. W,bW,cVbca,i6) 

j b b,c 

where 

Jij,a = [ dt f dt' F(t-t')[XX(j)a](t)(j)a(t') (7) 

Cba = j dt j dt'F{t-t')[Xeleb\{t)ej>,{t') (8) 

Vb,a = j dt j dt'Fit-t')[X^^Ub<l^c]ma{t') (9) 

First, the expectation value Jij^alWij produce a sim¬ 
ilar value for all a when the activity of input neurons 
are similar, and become a positive value when F(t) > 0 
for f > 0 because X{t) has positive values only for small 
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FIG. 1: Learning results in a network composed of two 

layers with one-dimensional structure. Interaction parame¬ 
ters are given by (a) {a, P, a, a', /3') — (0.3,0.05, 16,0,0) and 
(b) {a,P,a',P',ai) = (0,0,0.3,0.05,16), and 7 = 0.02 and 
^abc ~ 0 cases. The network size is = 40 and 

M = 50 for output and input layers, respectively. 


positive values of t in usual. Considered the lateral con¬ 
nections Wij become positive in short-range and negative 
in long-range in a cortex area, the lateral interactions is 
expressed in the form 


Jij,a — Jij — ^ij 'y: (^ 0 ) 

where equal unity for a nearest-neighbor pair {i,j), 
and vanish otherwise. It is also possible to derive the 
negative part of the lateral interactions independently of 
inhibitory connections if the firing propagations and the 
form of F{t) are considered in detailjlo, 1^.1^. 

Meanwhile, Cab is determined by the firing correla¬ 
tion of between two input neurons. If / dt F{t) < 0 and 
i^(t) > 0 for t > 0 , the expectation value changes its sign 
from positive to negative with decreasing input correla¬ 
tion, where the correlation decreases with the distance 
between input neurons in usual [^. Based on the prop¬ 
erty, the input correlation matrix is expressed in the from 


Cab = a exp 



/ 9 , 


( 11 ) 


where Aab is set by \va-Yb\^/2. 

Similarly, the tensor Vabc is determined by the firing 
correlation of three input neurons, which has the depen¬ 
dency on not only the distance between but also the lin¬ 
earity of neural positions because of frequent edge pat¬ 
terns in natural images. On that account, the input cor¬ 
relation tensor is expressed in the form 


Vabc = a' exp 


2cr^ 


3A 


abc 


2a| 


( 12 ) 


Here = tr(I])± 7 /[tr(E)] 2 —4 det(E) eigenval¬ 

ues of the 2x2 covariance matrix T, = E[{r — f)(r — f)^] 
with f = E[r\ = (1/3) X)^=a b c ’’m’ variance along 

the major and minor axis in the multivariate Gaussian 
distribution of r^, rf,, Vc three positions. Note that A^b 
in Eq. (EU also becomes the variance in the distribution 
of Ya, Yb two positions. 

In addition, it is assumed that the length of the feed¬ 
forward connection vector = EaWfa for all i is 

normalized to unity during the evolution. 


It is possible to predict from the previous studies what 
features would emerge when the learning rule has no 
nonlinear term. Reported was that a linear model with 
the form /AWia=[JW-\-WC]ia could lead to the devel¬ 
opment of a topographic map when both J and C pro¬ 
duce positive values for close neurons and negative val¬ 
ues otherwisef^. Especially, the solution of the lin¬ 
ear model is well studied for a neural network with a 
one-dimensional lattice structure: Close output neurons 
would have connections from close input neurons, where 
in-coming connections into the output neurons and out¬ 
going connections from the input neurons form a near 
Gaussian distribution. Here the distribution of in-coming 
connections from input neurons to an output neuron be¬ 
comes the receptive field of the output neuron. However 
the nonlinear term is considered, the correlation tensor V 
should exert the same effects on the network formation 
with the correlation matrix C because the three-point 
correlations contain no more typical feature for the one¬ 
dimensional lattice structure. Figure [TJa) (or (b)) show 
the emergent connection structure in a neural network 
when only J and C (or V) provides with valid coeffi¬ 
cients. 

Meanwhile, the learning model has the possibility to 
have the other type solutions when the neural network 
has a two-dimensional lattice structure. The Gaussian 
distribution form of receptive fields could polarized when 
they have difference variances along major and minor 
axes. And then, it deserves that the neurons acquire ori¬ 
entation selectivity through breaking of the radial sym¬ 
metry in the receptive field. 

In order to investigate what factor causes such sym¬ 
metry breaking, it is first examined the effects of the 
parameter 7 , determining the degree of competition be¬ 
tween neurons, on the network formation. It is known 
that there is a critical value in the degree of competition 
only above which localized receptive fields develop [l^. 
If the degree of competition becomes more severe, the 
form of receptive fields would be distorted to reduce the 
overlap between neighbors. 

Figure [2](a) shows the emergent receptive fields for dif¬ 
ferent 7 , where the effects of the tensor V is ignored by 
setting (q:',/3') = (0,0) so that the network formation is 
led by only the linear interaction terms. In comparison 
with the near isotropic shape for an intermediate value 
of 7 in the left figure, the form of receptive fields become 
elliptical for a large value of 7 in the right figure. A simi¬ 
lar phenomenon is observed when the network formation 
is led by not C but V (Fig.^Jb)). Namely, the symmetry 
breaking mechanism is regardless of the nonlinearity in 
the learning model. 

Nevertheless, the emergent columnar patterns in 
Fig. [SJa) and (b) have something difference character¬ 
istics with experimentally observed ones. They possess 
a single singular point, around which the preferred angle 
changes by 360° along a closed loop; however, pinwheels 
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(a) 


(b) 


(c) 


FIG. 2: Emergent receptive fields in a networks com¬ 

posed of two layers with square lattice structure. The 
lines represent the direction of and the degree of ori¬ 
entation selectivity. Interaction parameters are given 
by (a) {a, P,a,a',/3') = (0.1,0.03,20,0,0) and (b-c) 

(a,/3, a',/3', CTi) = (0,0,0.1,0.02,20) with cr 2 = 5 and 0.4, 
respectively, in the network of size {N,M) = (2x2,10x10). 
The parameter 7 is given by 1 in the left figures, and 4, 4, 2, 
respectively, in the right figures. 
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FIG. 3: Illustration of singularities, around which the orien¬ 
tation changes by multiples of (a-b) 360° or (c) 180° along a 
closed loop. 


in an OP map are singular points around which the pre¬ 
ferred angle changes by 180° (see Fig.|3]). In addition. Al¬ 
though pinwheels, understood as a topologically excited 
state, are used to disappear during a cortical develop¬ 
ment process, the sin gul ar points do not vanish to the end 
in the simulations [5|, ll4|. The phenomenon is caused by 
that the singular points develop inevitably when a group 
of neurons acquire orientation selectivity simultaneously 
through the squeeze of neighboring receptive fields. 

Next, the emergent shape of receptive fields is exam¬ 
ined when the correlation tensor V has a high degree of 
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FIG. 4: Ghange in the eccentricity of receptive fields, de¬ 
pending on (T 2 . Interaction parameters {a, I5,a', P', ai,y) = 
( 0 , 0 , 0 . 1 , 0 . 01 , 20 , 0 ) have been used in a network of size 
(A,M) = ( 1 x 1 , 8 x 8 ). 


anisotropy, where the degree is controlled by the ratio 
of (72 to (Ti. Figure HKc) shows that orientation selectiv¬ 
ity develops when (T 2 is much smaller than tri and the 
effect of the correlation matrix C is ignored by setting 
{a, j3) = (0, 0). Observed is that the neurons acquire ori¬ 
entation selectivity independently of the degree of com¬ 
petition, but form different columnar patterns depending 
on the degrees. They have similar preferred angles with 
neighbors for a small 7 in the left figure and different ones 
for a large 7 in the right figure. The effect of competition 
on the columnar pattern accords with the prediction in 
the most low-dimensional feature representation models: 
The degree of competition determines the gradient when 
the preferred angles change smoothly along a direction 
in a patch of the columnar pattern [5l4lll|. 

Compared with the first mechanism, the second de¬ 
serves to be a spontaneous symmetry breaking mecha¬ 
nism because a single neuron could acquire orientation 
selectivity independently of the existence of or the inter¬ 
action with neighboring neurons. In addition, the exis¬ 
tence of a singular point is not indispensable to the emer¬ 
gence of orientation selectivity, as shown in Fig. He). It 
is also investigated the change in the eccentricity of re¬ 
ceptive fields, depending on 02 for a fixed cri, in a neuron 
system with a single output neuron (Fig. |4]). The graph 
exhibits that the isolated neuron could have an elliptical 
receptive field when a 2 is larger than a critical value, and 
the eccentricity decreases with increasing cr 2 . 

Finally, it is examined the development of a colum¬ 
nar pattern with the orientation selectivity as well as the 
topography in a larger lattice structure (Fig. [S]). The 
center of receptive fields form a proper topographic map, 
and the polarity of them an OP map. The OP map have 
several singular points around which the preferred angles 
change by multiples of 180°. 
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FIG. 5: Distribution of (a) orientation selectivity and (b) 
topography after learning in a network composed of two 
layers with square lattice structure. Interaction parame¬ 
ters (a, /3, a',/3',(Ti,(T2,7) = (0,0,0.5,0.1,20,0.4,1) have been 
used in a network of size {N, M) = (15x15,10x10). 

IV. DISCUSSION 

In this paper, it has been examined in a learning model 
that the development of orientation selectivity and the 
formation of columnar patterns. The model is a much 
simplified one in consideration of the complex develop¬ 
ment process and the detail structure of early visual sys¬ 
tems, such as the genetic effects, the relay of visual sig¬ 
nals via LGN, the different types of RGCs, and so on; 
however, such a minimal model is helpful to understand 


the essential mechanisms for the development of typical 
properties in a neural network. 

In the case of retinotopy or OD, it is known that a 
linear model can lead to the development of the neural 
feature and the formation of a proper columnar pattern. 
The key mechanism of both the feature development is 
the (block) diagonalization of the input correlation ma¬ 
trix depending on the symmetry in visual inputs (l9l. 1^. 
Analogically, it was also suggested that the development 
of orientation selectivity may be explained similarly by 
the diagonalization of the correlation matrix via the ro¬ 
tational symmetry in visual inputs[2^. Nevertheless, it 
has been not demonstrated until now whether the devel¬ 
opment of a proper OP map is possible just by adjusting 
the form of the correlation matrix in a linear model. 

Observed in this paper is that the development of ori¬ 
entation selectivity is possible in a linear model; however, 
the feature development mechanism does not relate to 
the correlation matrix diagonalization. The mechanism 
bases on the competitive relationship between neighbor 
neurons, where the degree is determined not in the input 
correlation but in the lateral interaction matrix. Nev¬ 
ertheless, it is difficult to explain the OP development 
in the brain by the the first mechanism. However the 
mechanism leads to the development of a columnar pat¬ 
tern with different preferred angles and singular points; 
the emergent pattern has different characteristics with 
experimentally observed ones. 

Meanwhile, the other mechanism of orientation selec¬ 
tivity development is found when the model is extended 
to have a high order interaction term. The requisite of 
the nonlinearity for the model seems to be natural in con¬ 
sideration of that the effect of frequent lengthy patterns 
in visual scenes can be reflected only by the input corre¬ 
lation between three or more neurons. The characteris¬ 
tics of an emergent columnar pattern also coincide with 
those in the experimentally observed ones. The second 
is a kind of spontaneous symmetry breaking mechanism, 
i.e., a single neuron could acquire orientation selectivity 
independently of the interactions with neighbors. The 
spontaneousness is in close connection with the instabil¬ 
ity of pinwheels, i.e., individual receptive fields should 
have orientation selectivity independently, like spins do, 
if pinwheels are indeed topologically excited states. The 
second mechanism is also an interesting one in the view of 
physics if it is considered that there are several models to 
explain a spontaneous symmetry breaking phenomenon 
by the effect of a higher-order interaction termj^. 
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